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ABSTRACT 

Some of the issues, history, and approaches in the 
testing of second language writing skills are reviewed. It is argued 
that because writing serves many important functions in the lives of 
individuals and activities that speech cannot do equally well, it is 
time to stop viewing writing as secondary to speech and to accord it 
equal attention. Most of the attention should be devoted to "writing 
with composing," the making and conveying of meaning by writing. It 
concludes that the testing of second language writing would benefit 
greatly from the very intensive work undertaken in the field of 
native language acquisition, and that both disciplines would benefit 
from closer cross-disciplinary ties. (MSE) 
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TESTING WRITINS ABILITY: A REVIEW 



Sauli Takala 
Institute for EcJucational Researdi 
l»iivBrsity of J^vSskyia 



1. Seme Basic Issues in the Testing of Writing Ability 

Several problems ha\7e occupied those researchers who have been working on 



(1) Hew can writing ability be defined or at least delimited? 

(2) Is writing ability one unified construct or can At be measured by measur- 
ing its different conponents? 

(3) If writing ability is measured by w^ of conponents, how stoild th^ be 
weighted, if at all? 

(4) How can good writing tasks be constructed? 

(5) Hew can valid and reliable rating methods be developed? 

2. A Brief Historical Sketch 

As Kelly (1969) notes, in classical tljnes the peak of education was the 
art of rhetoric, whicdi combined artisty in word use, logical reasoning, and, 
xisually the techniques of public speaking. In classical times, what was 
written was usually also read aloud and elocution was an inportant part of 
jtraining. , ^, 

Relly also suggests that throughout the history of language teaching, 
four types of exercise have been used in teaching ocnposition: transcription 
and consequent rote learning of models, structural variation of models, imita- 
tion of masters, and original writing. 
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v:.. In medieval times the practice of verse oonposition held an inportant 

positicxi in Latin and Greek, 'but in more recent tinies prose writing has 
totally eclipsed verse writing, whly^ John Milton, for one, would have 
approveci. Medieval rhetoric concentrated cn written oon^x^siticn, following the 
teaching of Quintillian and Cicero's Togica. However, in the 1800 's free 
ccnposition, vdiich had been incareasingly criticised, was largely replaced by 
text exegesis and translation. tJhiie translatioi had in "ins time of the 
Renaissance been advocated as a useful mathod of cultivating stylistic con- 
sciousness, , it later became to be used to teach more elanentary skills of 
making ccrrect sentences and joining them together. Teachers were reoannended 
to analyse carefully shortocmings in stuc3ent writing. Translatic»:i was acquir- 
ing a basically negative stance. By the end of the 19th century, translation 
always preceded free ocnpositior. or totally ousted it from the curriculum. A 
Icxig way had been travelled from an enjiiasis on ideas and graceful exgressxoci 
(feel for language) to an en^phasis on correct structure and linguistic equi- 
valence. 

In more recent times, the role of sfpeaking and hearing was clearly enpha- 
sized at the expense of readLng and, especially writing. Thus, e.g., the 
syllabus for the upper secondary schools in state of Hessen stated (1957) that 
listening and speaking precede reading and writing. The instructiOTs for 
Hambflirg fran the same period specify that oral exercises ace central in lan- 
guage study and that written exercises grow from the oral ones. The influen- 
tial Ankara conference (1966), sponsored by the Council of Europe, recom- 
mended that students should be able to write vdiat -tiiey are able to say. 
Finoodiiaro (1965) suggested that writing shcxild be taught and practised only 
to a limited esrtent in the teaching of foreign languages in primary grades. 
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One of the scholars in whose honor this; testing symposiijm has been 

arranged, Robert Lado (1962), has defined the ability to write as follows: 

Vte will then defjjne writing a foreign language as the ability to use 
the language and its graphic representation producti''7ely in ortJinary 
writing situations. More specifically we msan by writing a foreign 
language the ability to use the stnictures, the lexical items, and 
their conventJ.onal representation, in ordinary matter-of-fact 'writ- 
ing. 

Valette (1967) considers writing to ba the most sophisticated of the four 
language skills. According to her, ccmmunication through the written word 
"possesses a certain degree of finality and demands real proficiency frcra V:^ 
writer if it is to be effective"' (p. 131). Valette took a developmental point 
of vi€?w in her reoomnendations concerning the testing of writing. Thus tests 
should be structured so that they measure the various aspects of student 
progress of acquiring writing skill: the mechanics—vocabulary, spelling, 
grammar—have to be acquired before the student can aspire to precisiai of 
e:qpression, fluency, and style. (Note how correctness, rather than connunica- 
tive effecUveness, seems to dominate her thinking here. ) Valette lists a 
number of ways testing partial aspects of writing, mucdi in the style of Lado. 
In discussing composition, she states that "a composition measures the 
student's ability to organize his thoughts, to choose his vocabulary, to 
formulate his sentences - in short to commit his ideas to paper" (p. 157). she 
notes problems related to the amount of time needed for scoring and the 
objectivity of scoring. Among ccnposition tasks she mentions "point of view" 

ocMJOsitlon Jphysical_descriptions, emoticxial- states ) letter-writlng~cxnveiF~ 

tions, and thougfit-provoking ess^^. 

Harris (1969) points out that the teaching of writing as an integrated 
course is normally deferred until raiJier advanced courses in foreign language 
stuc^. He views writing as a conplex skill involving the simultaneous practice 
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of a number of very different abilities, cnly sane of whi.ch are strictly 
lixiguisfcLc and seme of whidi are never fully achieved by many students, even 
in their native language. Harris recxjgnizes five general ccsi^xanents of the 
writing process: content, form, granmar, style, and mechanics. He reviews the 
defense of the essay e.xamination (real measure of writing abilities, motivates 
students to actually write, easy and quick to prepare) and the criticism 
levelled against it (unreliability, avoidai>ce of problems, long scoring time). 
Harris himself reocramends a combination of the objective and free writing 
tests, as did Lado. 

Heaton (1975) differs fecm most of the earlier lair^iage testing experts 
Ijy having a more sophisticated view of va."iting. He is conversant witlri old—or 
at least rediscovered—theory of written discourse, as shown by his discussion 
of the purpose and audience of writing and the forms (modes) of writing. 

HCeaton (1975) en^jhasizes Hiat it is Ijiportant to distinguish between the 
terms ocn^position and essay . He writes: 

The writing of a composition is a task which involves the student in 
manipulating words in grammatically correct sentences and in link- 
ing those sentences to form a price of oontlncjuus writing which 
successfully ccranunicates the writer's thoug^its and ideas on a 
certain topic. Moreover, since in real-life situations there is 
generally a specific purpose for any writing, ccmposition writing 
frequently takes -tJie form of letters, reports, extracts from dia- 
ries, etc. Essay writing, on the other hand, involves far more than 
the production of grammatically correct sentences: it demands cr^- 
tivity and originality, since it is generally intended not only to 
Inform but also to entertain. Essays on such topics as Clouds, The 
Jj^portance of Being Last, and The Oountryside at Night iire written 
to sparide and iirpress, and good essayists are as rare as good poets, 
(p. 127) 



Heaton coiSludes that it is generally neither reascxiable nor realistic to 
danand creativJ.ty and originality in the form of an essay, vflxLle it is reason- 
able to expect students to write accurate English for a meaningful purpose. 
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He aiso stresses ti^e oannunication aspect of writing in insisting itiiat 

■tt^e student should be presented with a clearly defined problem which 
motivates him to write. The writing tasJc should be such that it 
ensures he has scmething to s^ and a purpose for saying it. He 
should also have an audience in mind v*ien he writes, (p. 128) 

Heaton considers the writing skills to be complex and difficult to t«;ach, 
requiring the mastery of grammatical and rhetorical devices but also the 
mastery of conceptual and judgement elements. He lists the skills under four 
main areas: (1) grammatical skills: the ability to write corxecfc sentences, 
(2) stylistic skills: the ability to use language effectively, (3) mechanical 
skills: the ability to use oocrrectly conventions of written language, and (4) 
judgement skills: the ability to write in an appropriate manner for a particu- 
lar purpose with a particular audience in mind, together with an ability to 
select, organize and order relevant inforraaticn. 

Oiler (1979) suggests, quite correctly, that not all writing tasks are 

what he calls integrative and pragmatic task. Writing tasks qualify as 

pragmatic provided that certain key elements are present: 

the writer must have scmething to say; there must be sonecne to say it to 
(either explicitly or implicitly); the task must require sequential 
production of elements in the language that are tenporally constrained 
and related via pragmatic mapping to the context of discourse defined bv 
(or for) the writer, (p. 384) 

Oiler suggests that there is no real limit to the kinds of writing tasks that 

are potentially usable in larjgxaage tests. He mentions writing about personal 

experiences and Imagined topics; analyUcal or e:q)ository writing tasks; 

summarizing an argument; retelling a narrative; recallir^g an accident; 

:^J^i|?i|ig_aJ^ecture; — ^expandlng_on-a-summary; — filling-in the details in an- 

Inccnplete story. 

More recently Finocchiaro and Sako (1983) liave published "a practical 
approach" to foreign language testing. Its practicality seems to be limited by 
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f : ry-'[iirB fact that there seems to be little theory behind the xaarvi lists of test 
types. 

4. Sane Problems in the Past work on i±B Testing of Writing 

There are sane problems vd.th much of earlier vgork on the testing of 
writing cited in the above. First, writing has not received as much attention 
as a concern of testing as have several other aspects of language testing. 
Second, the literature does not display any thorough familiarity vd.th the 
concept of writing as a social act and as a psfychological process. Third, the 
nature of text and the variety of text types seems rather superficially 
treated. Rxirth, the authcsrs do not sean to have been familiar with the large 
amount of work done by mother tongue eaqjerts in the area of writing 
instctiction. Some of these problems are addressed In the following, beginning 
with the relative neglect of writing in recent work on the develqpnent of 
second language instruction and testing. 

Most testing e^qperts have not atSdressed the measurement of writing as 
thorou^y as other aspects of language proficiency. Testing literature does 
not often seem to go beyond the elementary or intermediate stages of lar.>,<uage 
teaching and learning, with their emphasis on oral ocmmunication skills. Yet, 
hundreds of thousands of students need to write a lot in a language which is 
not their first language. This applies to those co.jntries where the language 
of instructicxi is cxily a>e of the many dialects of a country, or a created 
standard language, or a language of the former colonizing power. Another 

9TOi^>-af fected-i^-the-students -who go-to study-abroad-a^ 

their studies need to answer written examlnatiais, write term papers and 
theses. A third group are those who, after conpleting their professional 
education, need the ability to produce at least the first draft of letters, 
memoranda, contracts, papers, instructions, etc. As IntemaUcnal contacts 
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intend and the language skill requirements increase, the literate bias of 
our own post-iiidustrial culture tends to make the skills related to written 
language moire and more JjipDrtant. 

It is possible that Oiler's claim (Oiler, 1979) that language ability is 
unitary ( a claim he has more recently taken back. Oiler, 1983) vras based on a 
number of assumptions of language use several of which have proved questioi- 
able: he seems to share the view that children had essentially learned most of 
the structure of their LI in the early years, and like so many experts In L2, 
he has not been Interested in advanced foreign language skills (e.g., ESP, 
LSP) and thus not in writing in L2. Also, he does not seem to have been aware 
of recent research in literacy. All of these would have indicated that while 
various language skills obviously are related, there are also clear differ- 
ences. Speaking and writing, for instance, emphasize scmewhat different 
functions of language and they prefer scmewTiat different structures of lan- 
guage (cf. Perera, 1984; Takala, 3982). 

Second, the concept of writing seems to have been rather poorly defined. 
Language testing needs to take a broad view of human activity: it should place 
language activiUes within the broader context of general human activity and 
purposes. Mare of this in section 5.1. 

One of the most Important cxandiUons for advaix:e in the testing of 
writing Is a better understanding of text, text structures and text types and 
how these are related to the constants and parameters of the writing 
situaUons. Most of the knowledge relevant in this context cones from literary 
criticism and from the research dons on mother tongue instruction. More on 
this topic in section 5.2. 
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5; Key Oaiipuijents In Developing the Metitodology of the Testing of Writing 

For making real progress In the testing of writing it is necessary to 
devote considerable attention to (1) the definition of the concept of writing, 
(2) the delf inition of the domain of writing, (3) the selection and definition 
of writing assignments, (4) the development of scoring systems that maximize 
the reliability of scares and the validity of score Interpretations. 

5.1. Writing as a concept 

The present author (Takala 1982) has defined writing as follows: 

Writing is a multilevel Interactive and goal-directed process of 
constructing, encoding and ocmmunicating meaning by means of a 
oonventicarial system of visible marks (p. 220). 

Writing as a construct can be further defined In a manner, which draws on the 

findings of modem cognitive psychology concerning discourse comprehension and 

builds on the discourse theory itself. The developed system can be suimiarized 

In a diagram form as follows (Takala, 1983, 1985). 



WRITING ACTIVITY 
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"Writing ccnpetence" or "writing ability" can be qpeiationalized as the 
ability to produce texts that cover the cells of the domain of writing (vahS- 
passi 1983). A person may be able to write fluently a given type of discourse 
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(e.g., a stxary, a personal letter, an acacJemic paper). Such a perscxi may thus 
^Jprppriately be called a competent or fluent story-writer, or letter-writer, 
but it is less clear if we can apprppriately refer to him or her as a compe- 
tent writer: the competence seans to be too limited to justify the epithet. To 
deserve the title of a competent writer, he needs to be able to write across a 
large range of tasks. 

Writing oonpetence, as a theoretical construct, can be argued to consist 
of two main components: discourse-structuring competence (or discourse-produc- 
ing or rhetorical oonpetence) and text-producir^ ccnpetence. 

Discourse-structurlnq ccnpetence requires both cognitive and social com- 
petence. Cognitive competence refers to the cognitive ability to encode 
meanings and Intentions effectively. It denotes the ability to generate dis- 
course in which the units of thought and the units of language are related to 
each other in such a way that an appropriate structure of meaning is produced. 
The appropriateness is always dependent on the intention of the writer and the 
nature of the Intended audience as well as the topic dealt with: appropriate- 
ness is not a universal concept, it is always context- and situation-specific. 

It is Ijiixjrtant that the writer is able to present ideas that are perx^ep- 
tive, relevant and clear for the audience of writing-. This can be called (the 
ability of) idea generation . However, this is not sufficient. The ideas must 
also be arranged In a consistent and coherent way, so that a discourse type 
is recognized and the text is made Intelligible. This can be designated as 
(the ability of) idea organization . It is not Immaterial how the meaning is 
organized in a linear text. Ease of comprehension is usually better if the two 
coincide. It has also been shown (Brewer & Lichtensteln, 1982) that events in 
a story have to be arranged in a certain order for the story to produce either 
suspense, surprise or curiosity In readers. Readers have genre-structural 
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;jaxwieage ana^e^ sufficient ocmfonnity with typicjal genra sd^ta. Simi- 
larly, discourse has to be structured differently if the type of text to be 
produced changes fecm narrative to persuasion, to description or to exposi- 
tion. 

Since writing is usually addressed to an audience other than self, dis- 
course-structuring competence also presupposes social competence . The writer 
has to be aware of audience e:5)ectations (norms) and use an appropr i ate tone 
and style. 

Text-prod ucing ocnipetence can be divided into two parts: linguistic 
competence and motor canpetence. Linguistic competence consists of the ability 
to produce sentences using apprqpcdate grammar, spelling and punctuation, 
ftotgr competence refers to the ability to produce an easily legible text. 

5.2. Domain of Writing 

The validity of writing assessment can best be addr. : 3ed In terms of 
construct validity, content representativeness (or validity) and cuiricular 
validity. Since we do not have any clear notion of the psychological structure 
of writing, i.e., how general or how task-specific it is (see above, 5.1), 
construct validity can best be guaranteed by an analysis of the general 
features of writing situations and a resulting defensible specification of 
the domain o£ writing tasks. This is a functional approach to construct vali- 
ditjr and it was used in the lEA International Study of Written Ctmposition. In 
other words, since it is not easy to say directly what writing ability con- 
sists of, we chose to look at what functions writing has in general and in 
what situational contexts it occurs, ihis means that we have focussed on the 
initial conditions of writing and on its functions. This approach is derived 
from ideas expressed by de Saussure and Wegener'- and further elaborated by 
Gardiner in his The ThBogY of Speech and Language (1932) and by Jakobson 
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(1960). Ihe Finnish language scholar Rolf Pippiixr has dealt with similar 
topics in his SprSk och stil (1940), vte^e he shows how styles are related to 
the relationships between the three extralinguistic factors (speaker/writer, 
listener/reader, topic) and the linguistic factor (text). 

Language testing needs to ocnsider v*iat are the constants, parameters and 
variables of language use (Takala, 1986). Roughly speaking the constants are: 
sender/ addresser, receiver/addressee/audience, topic, channel and text. The 
parameters represent the various characteristics that specij^ the actual 
characteristics of the constants (e.g., the identity of the writer and audi- 
ence, purpose of writing, assumed background knowledge, the perspective from 
vjhich the topic is dealt with, etc., see Purves, Soter, Takala & vahSpassi, 
1984) . The variables are the modes of organizaticn and the use of rhetorical 
and linguistic resources. Language testing should not be too much preoccupied 
with linguistically based concepts and is not sufficiently sociological, 
psychological and educational in terms of its research questions and units of 
analysis (cf. Takala, 1984). 

In the lEA International Stucfy of Written Odnposition, for v*d.ch I have 
acted as the ooardinator since 1981, we have attenpted to develop a definition 
of the domain of writing on the basis of the approach described in the above 
(see vahSpassi, 1982; Takala & vahMpassi, 1983; Takala & VShSpassi, 1987). ^ 

Briefly, vahSpassi suggests that in any writing situation, there is a 
writer wto writes about scroathing with a certain purpose and audience in mind. 
Writing is an act of oomniunication and sn activity of cognitive processing. 

vahSpassi systematizes the domain of writing by taking coranunication and 
cognitive processing as two main dimensions of her typology (Figure 1). On the 
oonmunication axis (i.e., functional approach to writing) she distinguishes 
several dominant purposes of writing and specifies main categories of audi- 
ence. On the cognitive procecslng dimension (i.e, genetic approach to writing) 
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she distii^guishes three hierarchical levels of processiiig and specifies main 
categc3ries of content v*iich is psrocessed. This systan procauces a grid and 
various text types can be located vd.iiiln its cells. It can also be used in 
selecting assignments for writing, 

,.To cxxx3lude "Uiis section, let me reiterate that can hope to make real 
progress in the testing of writing only if we contiJiue to take seriously the 
prbblan of conceptual nature of writing ancl tl.se domain of writing tasks. 

4. Test Types for Measuring Writing Ability 

Once we have some idea of the nature of writing and of the domain of 
writing tasks we can tackle the question of possible test types to be ijsed in 
testing of writing ability. 

Lado (1962) made a clear distinction between creative writing and ordi- 
nary writing. Also, consirtently with his habit errphasis and habit transfer, 
Lado believed that the testing of writing could be advanced best by listing 
the particular problems that a writer's particular linguistic background was 
expecb&d to create. 

Lado distinguished between an integrated method of testing writing 
asking students to produce a connected piece of writing (what now would often 
be C5aied "writing with con^posing" or "a direct measure of writing abiliiy") 
and a method of testing writing with separate factors such as punctuation, 
spelling, structure or vocabulary ("writing without oonposing", "an indirect 
measure of writing ability" ) . This latter method would make it possible to 
sanple the problems systanatlcally. Lado recognized, however, that the 
validity of the synthetic aKxroach was not readily conceded and he discussed 
ways of inprovlng tiid objectivity of scoring conposition tests. 

Lado recAatmended a many-sided test of writing, and suggested the follow- 
ing as Oi:^ possible design: (1) Objective, partial productlcxi, multiple-choice 



itans (50-80) dealing with specific pErdblems of spelling, punctuation, grain iia- 
tical structure, and vocabulary. (2) Twenty or -Uiirty itans of the objective, 
partial producticn type on a single connected passage testing chiefly matters 
of sequence and transition signals* (3) Three pictures with instructions to 
write a paragraph about each with grading based on mechanics only (= number of 
errors per 100 words). (4) Two short oonpositions on assigned topics (30 
minutes each) with grading based on style, content and mechanics. Roughly 
similar views have been presented by Valette, Pilliner and Finocchiaro and 
Sato. 

In recent tinies, there have been attenpts by experts in LI instruction to 
develop mei±iods for a domain-references measuranent of writing (Baker, 1982). 
These appear quite promisir^ for L2 testing, as well.^ 

6. Schemes for Rating Written Products 

Several systems have been pr oposed to be used in the evaluation of 
student writing. Many are based on long pedagogical traditions, but seme are 
based on enpirical studies. There are also several ways of classifying methods 
of measuring writing ability. VJesdorp (1981) suggests the following classifi- 
cation: global rating, primary trait scoring, analytic scoring, scale rating, 
interldLnear method, objective testing.^ 

In iliis paper I will mainly discuss writing with oonposing and discuss 
holistic scoring, analytic scaring and primary trait scoring as the most 
ccmmon forms of rating written products. I shall begin with holistic scoring. 

Typical of holistic soaring (e.g.. Cooper 1977) is that the rater takes a 
script and ei-Uier (1) matches it with another piece of writing in a graded set 
of scripts, or (2) rates it far the quality of certain features considered 
important to that kind of writing, or (3) assigns it a letter or number grade. 
The placing, rating or grading is done quickly, on the basis of the first 



linpression, after the rater has practised the procedure together vdth other 
raters. Holistic soaring, conducted with rigor, uses scoring guides, or 

•rubrics, vghich distinguishes it from a nore haphazard inqaressionistic scoring. 

Perhaps the best known analytic scaring system is the one developed by 
Diederich (1974). The Diederich scale was developed etrpirically by usii^ 
factor analysis. A sanple of writing was scored by ea^^erts representing diff- 
erent disciplines. The factors extracted were: ideas, organization, wording, 
flavor, and mechanics. The last category is scroetlmes sub-divided into usage, 
punctuation, spelling, and handwriting. Each factor is rated on a scale from 1 
(low) to 5 (higfi), and ideas and organization are rated on a scale from 2 to 
10 (ie. , they received a double weitgjiting). Thus the scores can vary from 10 
to 50. . 

Anotiisr exanple of an analytic scoring method is given by Quellmalz 
(1979). She defines an expository scale consisting of general inpression, 
essay focus/main idea (the subject and main idea are clearly indicated), essay 
organization (the main idea is developed according to a clearly discernible 
method of organization), support (generalizations and assertiOTS are supported 
by specific, clear supporting statonents), and mecihanics (the ess^ is free of 
intrusive and mechanical errors). 

^^allis (1980) eaqplains that ttie rationale of prijfiary-trait scoring is 
that writing is adclressed to some audience and it is judged in view of its 
effect on that audience. Primary-trait scoring focusses on assessing whether 
a piece of vgriting has certain characteristics or primary traits that are 
crucial to success with a given rhetorical task. Lloyd-Jones (1977) expresses 
the goal of prlxnary-trait scoring as follows: "to define precisely what seg- 
ment of discourse will be evaluated (e.g., by presenting rational persuasion 
between social equals in a formal situation) and to traind readers to render 



*u^Mua.v> ji*^i«aiiws amajiuiiKjxy. ^p. o/;. tte Stares rurtnsr tnat ttie main steps 
are to define the universe of discourse, to devise exercises vAilch sanple that 
universe precisely, to the writers' coqperaticsi, to devise workable scoring 
guides, and to use the guides. 

The universe of discourse is defined by a three-part model, which can be 
discourser oriented (e:iqjressive discourse), subject oriented (explanatory 
discourse) or audience oriented (persuasive discourse). The scoring guide 
consists of (1) the task itself, (2) a statement of the primary rhetorical 
trait of tlia writing which should be elicited by the task, (3) an interpreta- 
tiai of the task indicating how each element of the stimulus is presumed to 
affect the writer, (4) an Interpretatlcn of how the situation of the task is 
related to the posited primary trait (a sunmary of 2 and 3), (5) a system for 
defining the shorthand which is to be used in reporting descriptions of the 
writing (the actual scoring guides), (6) samples of papers vdiich have been 
scored (definition of the score points), and (7) discussions of wt^ each 
sanple paper was scored as it was (extensions of the definitions). 

Llo(yd- Jones (1977) suggests that primary-trait scoring has certain 
advantages vftiLch outweigji its difficulty. The explicitness of the scoring 
guide helps to establish i±ie validity of the scoring. By focusssing sharply on 
specific types of discourse, more Infcxnnatlon can actually be obtained from 
writers' strengths and weaknesses than by a more gbbal approach. 

In the lEA International Study of Written Oonpositlon both the overall 
litpression and analytic ratings are used because they are ocnplementary pro- 
cedures, not mutually exclixsive. The analytic ratings do not necessarily add 
to the general lnpnession. On the other hand, more specific information is 
obtained if analytic ratings are also made. The figure on the next page shows 
how the rating system is related to the psychological ccxicept of writing 
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described In the above (for a more detailed account, see Gorman & Purves, 
1986). 

The use of the same rating categories in all tasks is justified since 
content, organization, style, and linguistic correctness can all be distin- 
guished in all discourse (perh^ their configurations do in fact define the 
range of text types), and the rater also tends to make an overall quality 

WRITING ACTIVITy 



WRITING (XMPETENCE 



Text-constructing 
Oonpetence 




WRITING PREFERENCES 




Text-producing 
Oonpetence 



Cognitive 
Oon{)etence 



Social 
CixtpeterK^e 




Linguistic 
(jonpetence 



Idea Idea 
Gener- Qrgan- 
ation ization 



Nbrm 
Aware- 
ness 



Gramnfia- 
tical 
Ocxipet. 




Motor 
Oonpetence 



Punctu- Spell- 
ation ing 



Quality Present- A p prop- 

& ation riateness 

Scope & of Style 

of Qrgani- & 

Content zation Tone 
Content 



3S Cbnpet. Oaipet 



Legibi- 
lity 

Cbnpet. Oonpetence 



Usage 



Spelling Neatness 



estimation. It has to be at^iiasized, however, ±hat the specific meaning of 
each category is defjlned task by task . To take an exanple, the content clearly 
varies task by task, and the organization of a story is different f ran the 
organization of a reflective essay. As stated in the above, even within the 
story genre the sequence of events has to be arranged in a different orxSer 
depending on whether the aijn is to bring about in the reader a response of 
suspensei, surprise or curiosity. There is ro a priori reason to assume that a 
writer autanatically masters such discourse-organization skills. On the con- 
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trary, it Is mare likely that all these story organization patterns have to be 
learned thnou^ exaitples and through practice. Similarly it is possible that 
the granmatical, punctuation and spelling skills vary to seme extent frcm task 
to task. Different genres call for somev*iat different types of syntactical 
structures (Perera, 1984). 

Wesdorp (1981) has assessed the practicality of various methods of ass- 
essing writing and summarizes his conlxasions in a table form as follows: 





Global 
Rating 


Primary 
Trait 


Analytic 
Scoring 


Scale 
Scoring 


Inter- Objective 
linear testing 




Indiv Jury 


Jury 


Jury 


Jury 






Chances of obtain- 
ing high reliabi- 
lity? 


Mb 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Chances of obtain- 
ing reasonable 
content validity? 


Mb 


Yes? 


Yes 


Yes 


Yes 


Nb 


Nb 


Practicality 
in teaching? 


Mb 


No 


Yes 


Yes 


Nb 


Yes? 


Nb 


Feasibility in 
selecticns? 


Mb 


Yes 


Yes 


Yes 


Yes 


Nb 


Yes 


Chances of posi- 
tive washback 
on teaching? 


Mb 


No 


Yes 


Yes 


Yes? 


Nb 


Nb 



7. What Does a Rating Depend On? 

Pnvong many interesting questions, the Swedish EEtlS-Project (Lindell, 
1980) has esqplored whether ratings can be consistently predicted by a linguis- 
tic analysis of the scripts. The answer was affirmative: above all, producti- 
vi-ty predicted expert ratings. In other words, we can get a fairly good 
estlinate of the quality of a script by slnply checking its length. More 
specfically, ±he most lnportant factors were the number of different words. 
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the number of unusual (non-frequent) words, the number of punctuation marks, 
and vjocd length. Again, the daninant importance of good vocabulary in contrast 
to syntactic conpetence is demonstrated (Takala, 1984). 

8. Conclusion 

Writing serves many important functions in the lives of individuals and 
societies that speech cannot do equally well. Therefore, it is time to stop 
viewing writing as scmething very secondary to speech. This means that the 
testing of writing should be accorded equal attention as other aspects of 
language use. Mcsst attention should then be devoted to "writing with 
ocnposing", the making and conveying of meaning by writing. 

Testing of writing in L2 can benefit greatly fran the very intensive work 
done and being done by the LI profession. Therefore, L2 professionals should 
add the most important LI scholarly journals to their regular reading list. 
Both disciplines would benefit from close cross-disciplinary links. 



Notes 



^ Wegener strongly eniphasized the influence of the speech situatican can 
the form of the linguistic e^qpocession. 

2 

Murphy (1974) notes that if we are to understand western views of ocmrni- 
nication, we must recognize the dcniinant didactic Inpulse, the laying down of 
precepts for techniques that allow the speaker achieve, within the situation 
of discourse, the desired goal. Thus rhetoric had a pragmatic orientation: to 
oorxTlnoe the interlocutor. Aristotle, in his Rhetoric, defines rhetoric as the 
faculty of discovering all the available means of persuasion. He also made a 
distinction between epic peotry on the one hand and tragegy and ocmedy on the 
other. Aristotle clearly preferred the tragedy over the epic as higher art 
form, vMcih attains its end more perfectly. He also refers to "drama" as poems 
imitating persons v*o are acting and doing scmething. 

Kinneavy (1971) gives a succinct review worth quoting at seme length: 

... in /Antiquity, three main alms of language structured -tiie 
training in the art of discourse: the literary, the persuasive 
(rhetorical), and the pursuit of trutti (dialectical). The analysis 
of literary texts was the province of the secondary school: -tiie 
other two aims were "collegiate" and university concerns. In 
ocniEosition, vMch was directed to a preparation for rhetoric, 
certain fcams or modes were thought to be basic to all oonposition 
(narrative, description, eulogy, and definition) and structured 
the ocnposition program, (p. 8). 

However, Kinneavy suggests that the oonnon classification of the modes of 
discourse (forms, genres, types) into narration, exposition, argumentaUon 
and description was not fully established before the mid-1800 's (Bain's Ena- 
lish Ocmposition and Rhetoric , 2nd ed, 1867). 

More recently, Moffett (1968), Britton et al. (1975), D'Angelo (1975) 
Kinneavy (1971), Wilkinson et al. (1980) and others have attainted to define 
models for teaching composition. I will, however, refer to the work of VSha- 
passi (1982, 1983), as it has constituted an Inportant part of my own work on 
writing and since I have also had some contribution to make to the develcxxnent 
of that work. 



For a systematic analysis of writing assignments see Purves, Soter, Takala & 
vahSpassi, 1984, and for an illustration of task assignment see Gorman & 
Purves, 1987. 



Harris (1969) assumes that in a normal writing situaUon the student has 
something to say and a personal point of view. The student must observe the 
normal requirements of form and present his views effectively. According to 
Harris, thus, writing is a ccnplex skill, which must simultaneously take into 
account several points: 1) content, 2) form, 3) grammar, 4) style, 5) mecha- 
nics. 
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